-
Notifications
You must be signed in to change notification settings - Fork 91
Fix failing tests #421
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix failing tests #421
Conversation
3f0ac0e
to
dabe4b6
Compare
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
ba9203f
to
64aa2fe
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR fixes failing unit tests across the codebase, with most changes involving updates to reflect API changes in request/response schemas and class renames. Several tests that couldn't be fixed are marked as XFAIL
with run=False
.
Key changes:
- Updated test code to use new schema names (
RequestInfo
,RequestTimings
instead ofScheduledRequestInfo
,MeasuredRequestTimings
) - Replaced deprecated/removed classes and methods related to request timing strategies
- Marked unfixable tests with
pytest.mark.xfail(reason="old and broken", run=False)
Reviewed Changes
Copilot reviewed 21 out of 21 changed files in this pull request and generated 6 comments.
Show a summary per file
File | Description |
---|---|
tests/unit/utils/test_text.py | Added XFAIL marker to broken test |
tests/unit/utils/test_messaging.py | Updated imports and class names from ScheduledRequestInfo to RequestInfo |
tests/unit/utils/test_encoding.py | Updated imports and class references for renamed schemas |
tests/unit/testing_utils.py | Fixed logic order in async_timeout decorator |
tests/unit/test_main.py | Added XFAIL marker to broken test |
tests/unit/scheduler/test_worker_group.py | Major refactoring to remove deprecated timing registries and update test parameters |
tests/unit/scheduler/test_worker.py | Updated to use new strategy-based timing instead of separate timing classes |
tests/unit/scheduler/test_strategies.py | Removed tests for deleted timing classes, inlined calculations |
tests/unit/scheduler/test_scheduler.py | Updated imports and added missing startup_duration parameters |
tests/unit/scheduler/test_objects.py | Renamed test classes and updated to new schema names |
tests/unit/scheduler/test_environment.py | Updated RequestInfo import and usage |
tests/unit/scheduler/test_constraints.py | Updated RequestInfo import and usage |
tests/unit/preprocess/test_dataset.py | Added XFAIL markers to broken tests |
tests/unit/mock_benchmark.py | Updated mock object to use new schema structure |
tests/unit/mock_backend.py | Updated imports and class usage |
tests/unit/benchmark/test_output.py | Updated test setup to include required args parameter |
tests/unit/backends/test_openai_backend.py | Major refactoring to align with new backend API structure |
tests/unit/backends/test_objects.py | Updated to test new request/response schema structure |
tests/unit/backends/test_backend.py | Updated to use new schema names |
src/guidellm/scheduler/init.py | Removed exports for deleted timing classes |
pyproject.toml | Excluded tests directory from mypy checking |
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
Signed-off-by: Samuel Monson <[email protected]>
Signed-off-by: Samuel Monson <[email protected]>
64aa2fe
to
3add86f
Compare
Summary
Fixes tests whenever possible and marks remaining ones as
XFAIL
.Test Plan
tox -e test-unit
tox -e test-integration
tox -e test-unit -- --runxfail
Use of AI
## WRITTEN BY AI ##
)